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A Coiap arisen of ProT.iptlnf», and Adjunct Questions 
in Learning frora Text 
Don F. Keller and Donald J* Cunninsham 
Institute for Child Study 
Indiana University 

The study reported here is one of several conducted or planned by 
the authors 9 designed to explicate the nature of the processes utilized 
by students when learning from textual materials when the text has been 
aup,taented by interspersing questions at various points. Studies inves- 
tigating effects of questions in text have been conducted nainly under 
the rubric of rather^iagenic activities or behaviors. The key experiraen*: 
in the area was conducted by Ernst Z. Rothkopf of Bell Telephone Labori:- 
tories and reported in several versions (Rothkopf, 1965; 1966; 1972)* 
Briefly, this study investigated the effects of inserting questions in 
text either before or after the content to which the question referred. 
T^;o post- test measures were collected, one which assessed the same in- 
formation as that tested by the interspersed questions (practiced items) 
and another which assessed information not tested by the interspersed 
questions (non-practiced items). The questioned groups scored higher 
on practiced items (P ) than a control group which read the text without 
interspersed questions. Furthermore, groups which received questions 
placed before the relevant content (QB) scored less tjell on non- 
practiced test items (HP > than grouns which received questions placed 
after the relevant content (QA). This findinf5 has been replicatel several 



tines uslnt, Jlfferent natorials and subjects (See Frase, 1970, for a 
review) and appears fairly stable. 

Rothkopf (1970) has ari;ued that questions inserted in text alter the 
nature or character of the behaviors that students en^^aze in while read- 
ing text. These behaviors are referred to as nathemar^enic behaviors » 
behaviors which dctenaine the nature of effective stimulation that the 
reader receives. Sotie mathenaj^enic behaviors can facilitate the 
attainment of specific instructional objectives (mathetnagenic positive) 
or interfere (nathemagenic negative). Rothkopf (1970) has further stated 
that the character of xaatheaai^enic activities has to be discovered for 
each separate instructional situation and for each instructional ob- 
jective • l>Ievertheless, hz arp;ues, it should be possible to identify 
general classes of situations or objectives for which it would be 
possible to provide a general description of relevant nathemagenic 
activities. The present paper seeks to identify the nature of the 
matheiiiasenic behaviors in a quasi-instructional situation where the 
learner is reading text materials xrith questions interspersed. 

Specifically we propose to examine P and retention of text under 
various conditions in order to test hypotheses concerning the process-* 
ins strategies of learners. In the literature of the effects of adjunct 
questions on text learning, a nunber of variables have been examined such 
as Imowledf;e of results, question frequency, question type, etc. (See 
Frase, 1970j for a review) but as yet no conaistent picture of the pre- 
cise processes stud nts employ has energed. The c^eral strategy to 
be employed in our studies, of which this is the first > is to examine the 



effects of other manipulations of the instructual setting: (e«g«^ under 
lyins critical content » instructions, <tuessin|r strategies, motivational 
level) on the question position effect. From an extended and integrated 
program of studies such as these tre hope to be able to depict in a 
coherent manner the probable Information processing strategies of students 
reading; text trlth questions inserted. 

In the present study, the effects of underlining those ^lortions of 
the text ijhich TdLll provide answers to the adjunct questions was stud- 
ied. Such a manipulation was exnected to alter markedly th^ nature of 
the Q3 and QA treatments. Underlining should serve the purpose of direct- 
ing, S^'s attention to portions of the text critical to anstjering P items, 
hence increase P retention. The saire function has been presumed for 
questions, especially in the QB condition. IJould these effects be addi- 
tive? 

Uith respect to IIP retention, the most common explanation for the 
advantage of the QA group over the QB f;roup is that the Q3 z^^oup hunts 
only for anstrers to the adjunct question and i^ores or pays less atten- 
tion to the IIP material. The QA group has to read or pay attention to 
all of the material since he is generally uncertain what content vrill 
be tested. Underlining, then, could be expected to reduce markedly the 
advantage of the QA grouo since Ss In this group could direct their at- 
tention to the underlined material and nay less attention to the NP 
material. Such an analysis would predict, then, that the advantage of 
the QA group on IVP items would be less when underlining^ was also cnployed 
than when it was not. 
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Ilethod 

Ilaterlals 

The materials selected were those previously used by Prase (1967) 
and adapted accordingly for this experiment. The raaterlal consisted of 
a continuous prose passage of blo.'^raphlcal material about ^Jllllam James 
from Psycholof^y : The Science of Ilental Life, by JlUler (1962) The 
material vas divided Into n/enty paracraphs, each paragraph on a separate 
sheet of 5 X 3 1/2 Inch paper. Two sets of materials were produced - one 
version vjith and one Tfithout underlining. The Prase materials provided 
two multiple-choice questions (five alternatives) from each paragraph 
t^ich required the recall of specific factual information from that 
paraf^raph. The tt^o questions were constructed so as not to overlap in 
content. Twenty questions were used as practiced (?) questions on 
the post-test. These questions were inserted during the learning ses- 
sion for those groups which received questions before or after para- 
graphs. The other set of txfenty questions vaa used to test non-practiced 
(IIP) learning. The groups which received underlined versions had the 
ansiTers to the practiced questions underlined in the text. The forty- 
item criterion text was mimeographed on five 8 1/2 x 11 sheets of paper. 
Tt/enty P and twenty NP questions xTere randomly interspersed throughout 
the criterion test. 



Permission for using these materials kindly granted by Harper and 
Rot;, Inc. 



Subjects 

The Ss uerc sixty undergradiiate students from three Introductory 
educational psychology courses at Indiana Tjnlverslty. Participation in 
the experimental studies uas a course requirement, ^s uere randomly as-* 
signed to one of six treatrient groups » providing an N of ten for each 
treatinent. 

Piocedure 

The experlnental treatments trerc as follot;s: 

SBU. (Questions shortly before » underlined answers) ; just before 
starting each paragraph > read the question for that paragraph and was 
Instructed to <^ue86 the correct anm/er. After responding he read the next 
page and tras told to check his response uithout lookinf, back at the pre- 
vious page. £ uas informed that portions of the text had been enphasized 
(underlined) in order to help learn the material* 

SAU. (Questions shortly after, underlined ansi/ers) 5 read the 
paragraph TTlth the underlined anrwers. then was to mark the correct 
anst;er for the question on the following page. S^ ^'^s instructed as 
above about underlining. 

NQU. (No qu3stion8» but same underlined materials as SBU and SAU); 
was instructed to read the material > that portions of the text were 
emphasized in order to help learn the material^ and that they would be 
tested on the material. A control group. 

SB. (Questions shortly before) ; same directions as SBU except 
references to underlining. 

SA. (Questions shortly after) same directions as SAU except 



references to underlining. 

NQ« (No questions, no underlining), same directions as CU except 
references to underlining. A control group. 

Each worked through the text at his own rate. S^s were not per- 
mit ted-to review the text. Each group was Informed that they would be 
tested on how much of the content they could remember. was asked to 
record the starting and finishing time on the text materials. Immed- 
iately upon completing the text, all S_s were administered the forty 
question criterion test. The same test was administered to all ^s again 
five days later. 

Results 

The data were analyzed by means of a four factor, repeated measures 
analysis of variance with repeated measures on Test (Immediate or De- 
layed) and Scales (Practiced or Non-Practiced items). Question position 
and Underlining were between subject factors. Two separate analyses 
were conducted, one with (3x2x2x2) and one without (2x2x2x2) 
the control groups included. 

Analysis Including Control Group 

Tests and Scales were significant (p < .01) » while Question Posi- 
tion was not. The Underlining factor was marginal with .05 < p < .lO. 
Performance on the immediate test was better than performance on the 
delayed test, better on P items then NP items, and better on the 
underlined version than on the non*underlined version. A signifi- 
cant (p < .05) Scales x Underlining interaction indicates that the 



advantage of the underlined version is greatest on practiced Items. One 
other significant interaction was observed betv/een Scales and Question Pos 
Ition. Based upon prior research, It had been expected that on Practiced 
1 terns > the two questioned groups (QB and QA) would score higher than the 
control group. This was in fact the case although the difference was not 
as great as had been expected and did not reach significance. The NQ 
groups performed at a level somewhat higher than the QA groups, and sig- 
nificantly higher (p < .05 using Newman Keuls) than the QB groups on NP 
retention. 

A separate analysis was conducted using time to complete the text 
materials as the dependent measure. No time differences occurred as a 
function of the underlining treatment, \4hlle for the question conditions, 
NQ was fastest (as expected, since they had no questions to answer), SB 
was the next fastest, and SA was slowest. All time differences among 
txeetinent groups were significant (p < .05' using Newman Keuls). 

Analyses Excluding Control Groiips 

Underlining significantly facilitated total test score (p < .01) 
ar ! this effect was greatest on the practiced questions as shown by a 
marginelly significant (.05 < p < .10) interaction between Scales and 
Underlining. Alternatively, one might say that the retention of non* 
practiced items in the underlining and non-unaerlining groups was eqtiiva- 
lent 9 but that on practiced test itejos the underlining group was superior. 
The fact that the main effect for Underlining was significant on this 
analysis and only marginal in the previous one indicates that tftiierli 
had its primary effect when used in conjunction with questions. 



Retention of practiced items was higher overall than retention of 
non-practiced items (p < ,01), as in the previous analysis. Question 
position was not significant, but there was a marginally significant 
(.05 < p < .10) interaction between Question position and Scales in the 
direction consistent with previous research. Inspection of this inter- 
actiou reveals that question position had no Influence upon P test 
items, but questions placed shortly after text segments produced in- 
creased retention of NP content* 

Test, immediate or delayed, was significant (p < .01) as expected, 
with iuAaediate retention being higher than five day retention. This 
factor also Interacted with scales and Underlining at a marginally (.05 
< p < .10) significant level. This interaction appears to be an exteri- 
tlon of the scales x Underlining interaction reported above in which the 
advantage of the underlined group on practiced Items is greatest on the 
delayed test. 

Discussion 

Our original view of the processes £ employs la learning from texL 
was of a rather specific set of information search strategies under 
rather direct control of features of the lesson materials. In QB con- 
ditions, ^s is presumed to enter the question into memory and rehearse 
it so that it will be available to him when he turns the page and 
locates the answer. ^Then reading, £ will search for or be sensitized 
to material which will answer the questions. J.toterial not deemed per- 
tinent to the answering the question is not processed to the same extent 
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as the pertinent Information, \lhen the pertinent Information Is located. 
It Is processed or adapted to meet the demands of the question and It Is 
this additional processing vhlch makes the practice'' . 1 more memor^ 

able. Underlining was expected to facilitate S.'s scv, by pointing out 
the pertinent Information, We expected underlining and questions to com- 
bine their effects and produce greater retention of practiced material 
and less retention of nonpracticed material than either manipulation would 
alone • 

In QA treatments, reads the material, trying, we believed, to re- 
t^ember as much of the content as he can since the pertinence of the 
material can not be determined until the question itself is encountered. 
inien the question is encountere , must retrieve and review the infov^ 
tion stored and attempt to answer the question. This further processli.^ 
of the practiced material makes it more likely to be remembered than non- 
practiced material. The nonpracticed material has, however, been sub- 
mitted to processing (e.g., rehersal) which is not as likely to occur in 
the QB condition. Hence, the retention of nonpracticed material should 
be higher for the QA condition than the QB condition. Underlining should 
alter markedly the character of the processes employed in the QA condition 
in that Ss now can determine pertinence of content prior to encountering 
the question. 

This model seemed to handle fairly well existing data on learning 
from text with questions interspersed, but, of course, the viability 
of any model depends upon its ability to predict new data. In this 
study Question position interacted with Scales in a manner consistent 
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VTith i tor ^ research although the Interaction did not reach conven- 
tional levels of significance. Underlining,, too> functions about as 
expected on the basis of the model* Both questions and underlining 
appear to serve the function of dlrectlnp, S^'s attention to portions 
of the text critical to answering practiced Items and both appear to 
facilitate retention of practiced Items. 

Other expectations from the model, particularly those predictions 
trhlch xifere unique to this experiment, did not receive support. As out- 
lined above, vie had expected that the OB-QA difference on nonpractlced 
Items wuld be reduced substantially by underlining, l/hile there was : 
some tendency in that direction, the necessary triple order inter- 
action was not significant. It is possible that such effects would 
build up over a longer tirae or treatment but that speculation awaits 
further testin[^. IJe lidd also eiqiect^d that questions and underlining 
would produce greater retention of practiced material and less re- 
tention of nonpractlced material than either nanlpulation alone. Again 
the necessary interaction was not significant. 

A lack of significance on relevant interactions does not provide 
evidence against the information search model; only directly con- 
tradictory resu'^ts can do that. Some factors which might have con- 
tributed to the lack of stronger effects with respect to information 
search are treatment length and motivations. As mentioned abovG^ the 
effect sought here might be expected to build up over time. Hence, the 
relatively short treatments employed here would not allow a conclusive 
test of the search model. 
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Motivation is certainly also relevant here. S^s in these experiments 
all appeared fairly interested in the e*^periment especially in one of 
three classes used. As Frase, Patrick, and Schumer (1970) have shown, 
high incentive makes mathemagenic behaviors relatively Jjnpervious to ex- 
ternal manipulation. Some support for this interpretation comes from th3 
fact that in this study the control groups scored as well as the ques- 
tioned groups on practiced items whereas prior research has usually shown 
a strong advantage for questioning over no questioning on that measure. 
The incentive hypothesis is quite testable and will be pursued in the near 
future. 

At any rate, the information search model of mathemagenic behaviors 
receives no strong support in this study. The possibility is raised that 
the strategies posited here come under the control of treatment manipula- 
tions (e.g., questions, underlining) more often under conditions of low 
incentive or arousal. Further experimentation is under way on the effects 
of other manipulations such as recall instructions, question type, etc. 
on mathemagenic processing. These effects will be compared with predic- 
tions from the information search model in the hope that a more coherent 
and complete picture of learner behaviors in this particular situation 
wLll emerge. 
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